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COMMENTS  ON  A  PROBLEM  OF  CHERNOFF  AND  PETKAU 


Michael  L.  Hogan 
Columbia  University 


Abstract 


A  new  method  is  used  to  study  the  optimal  stopping  set  corrected  for  discrete* 
ness  introduced  by  Chernoff  and  studied  by  Chernoff  and  Petkau.  The  discrete 
boundary  is  asymptotically  the  optimal  boundary  for  a  Wiener  process  translated 
downward  by  a  constant  amount.  This  amount  b  shown  to  be  an  "excess  over 
the  boundary  term,  and  this  method  yields  it  as  a  simple  integral  involving  the 
characateristic  function  of  the  random  walk. 


Key  Words:  Excess  Over  the  Boundary,  Optimal  Stopping,  Wiener  Process, 
Corrected  Diffusion  Approximations. 


This  paper  consists  of  an  application  of  ideas  about  boundary  crossing  by  ran¬ 
dom  walks  to  problems  considered  by  Chernoff  [1065],  and  Chernoff  and  Petkau 
[1076].  In  [2],  a  Bayes  test  for  the  sign  of  a  normal  mean  leads,  in  the  diffusion 
limit,  to  an  optimal  stopping  problem  for  the  Wiener  process,  whose  solution  can 
be  shown  to  be  given  by  stopping  the  first  time  a  Wiener  process  crosses  a  certain 
boundary.  The  boundary  is  given  as  the  solution  to  a  free  boundary  problem.  In 
[1],  the  discrete  version  of  the  same  problem  b  considered.  Suppose  stopping  b 
permitted  only  at  times  n j,  n  =  0, 1, ....  Once  again  it  b  possible  to  show  that 
optimal  policy  b  to  stop  when  the  Wiener  process  crosses  a  certain  boundary  at 
the  permitted  times.  The  question  b:  what  b  the  relation  between  the  boundary 
i  (/)  of  the  unrestricted  problem,  and  is  (t)  of  the  restricted  problem?  Chernoff 
showed  that  is  (t)  =  i(t)+Z  where,  according  to  [1],  Z  ==  —.582. 

The  key  step  in  the  proof  of  thb  b  to  introduce  an  auxiliary  problem  in 
which  a  Wiener  process  b  started  at  a  point  {z,  (),  1  <  0,  each  observation  costs 
a  dollar,  no  payoff  b  made  if  stopping  occurs  before  time  0,  and  at  1  =  0  a  payoff 
Z^  I(Z<0)  received,  and  stopping  b  permitted  only  at  times  1  =  0,  —1, ....  For 
thb  problem  the  optimal  stopping  boundary  can  be  shown  to  be  increasing  and 
contained  in  [—1, 0],  and  therefore  it  has  a  limit  ast-*oo  which  turns  out  to  be 
Z. 

In  Chernoff  and  Petkau  [1976]  the  solution  to  the  auxiliary  problem  b  con¬ 
sidered  for  a  family  of  dichotomous  random  variables  depending  on  a  parameter 
p,  and  continuity  of  Z  as  a  function  of  p  b  establbhed,  as  well  as  a  method  for 
calculating  Z  when  p  b  rational. 

Thb  comment  b  a  result  of  a  question  of  Professor  David  Siegmund  after 
Professor  Chernoff’s  talk  at  the  Kiefer-Neyman  conference  at  Berkeley,  June 
1983.  Professor  Siegmund  remarked  that  ^  =  —ER,  where  Aba  random 


variable  whose  distribution  u  the  same  as  that  of  the  asymptotic  excess  over 
the  boundary  for  the  normal  random  walk  (see  below  for  precise  definition). 
Chernoff’s  analytic  machinery,  in  particular  the  probabilistic  interpretation  of 
the  solution  of  a  Wiener-Hopf  equation  (see  Spitzer  [1057,  1060])  shows  this  to  be 
the  case.  The  first  part  of  thb  paper  presents  a  more  direct  connection  between 
the  role  of  Z  as  the  expected  asymptotic  excess  over  the  boundary,  and  Z  as  the 
solution  to  the  auxiliary  problem.  The  second  part  identifies  the  quantity  Z  in  the 
auxiliary  problem  for  arbitrary  random  walk  with  oo,  and  fsstablishes 

the  continuity  as  a  function  of  p  in  Chernoff  and  Petkau’s  family  of  dichotomous 
random  variables  A  benefit  of  this  method  is  that  Z  can  be  computed  as  a  one 
dimensional  integral  involving  the  characteristic  function  of  Si. 

Here  is  some  notation  that  will  be  used  in  the  proof  of  Theorem  1;  however 
be  warned  that  due  to  the  extremely  heavy  notational  demands  imposed  by 
Theorem  2  these  definitions  will  only  hold  for  the  proof  of  Theorem  1.  Let  Sf 
be  a  random  walk  with  ESi  as  0,  ES^  —  1,  J?|5i|^<  oo.  Let  Ta  —  inf{n  : 
Sn  >  e}i  Ra  =  Sr,  —  a,  r^.  s=  fp,  and  A  be  a  random  walk  such  that  L{R)  = 
lima-»oo  L(Rah  ^kere  X.(A')  denotes  the  distribution  of  the  random  variable  X, 
and  where  a  -»  oo  through  numbers  of  the  form  nd  if  5}  is  arithmetic  with 
span  d.  This  limit  is  known  to  exbt  from  renewal  theory  and  it  b  also  known 
that  lima-»ao^Al  ~  ER-  H  b  easy  to  show  that  for  nonarithmetic  5i,  ER  = 
2E^  f  while  for  arithmetic  Si  with  span  d,  ER  =  2Est^  ~  as  a  oo  through 
multiples  of  d.  The  limit  as  f  oo  of  the  optimal  boundary  of  the  auxiliary 

m 

problem  will  be  denoted  Z.  (An  sritbmetie  random  variable  takes  values  in  a 
discrete  subgroup  of  S.)  A  lattice  b  a  coset  of  a  dbcrete  subgroup  of  9t. 


The  auxiliary  problem  b  as  defined  above,  except  that  the  random  walk 
generated  by  Si  b  run  rather  than  a  Wiener  process. 


Theorem  1.  Z  *= 

Remark.  According  to  Siegmund  [4],  Chapter  X 
z = jEsf  -  i  r*i&iog{2|i  - 

where  Re  denotes  real  part,  and  /(t)  3= 

Proof.  Suppose  the  optimal  boundary  b  given  by  Z(y),  and  that  the  random 
walk  starts  at  time  '-uq.  Let  T  =  inf{n  :  Sn  >  Z(n  no)}.  Recall  that  the 
same  boundary  is  optimal  regardless  of  starting  position.  Then,  Chernoff  and 
Petkau  show  that  the  problem  is  equivalent  to  picking  Z(y)  to  minimize 

E(S};  T<0)  +  EiS};  T  =  0,St<  0).  (1) 

Now,  assume  that  Si  is  nonlattice.  A  starting  position  can  be  chosen  so  that 
Sn  crosses  Z(z)  when  |Z  —  Z|<  €,  with  probability  >  1  —  e.  It  is  easy  to 
establish  uniform  integrability  of  S^  independent  of  starting  position.  Moreover, 
a  starting  position  can  be  picked  so  that  Z  is  very  much  larger  than  the  starting 
position.  The  small  variation  of  Z  makes  it  clear  that  Sf  has  approximately  the 
distribution  Z  +  R.  Thb  can  be  made  rigorous  using  simplified  versions  of  an 
argument  presented  in  Hogan  (1084).  Lemma  4.1  stochastically  bounds  5^,  and 
the  argument  of  Theorem  4.1  of  that  work  establbhes  the  statement  about  the 
dbtribution  of  Sx-  The  idea  in  thb  case  b  clear:  the  nearly  constant  boundary 
Z  can  be  replaced  by  the  constant  boundary  1^.  Therefore,  by  (1),  the  problem 
b  equivalent  to  minimizing 

£;(Z  +  i?)2  +  q 

where  q  can  be  made  arbitrarily  small  by  a  suitable  choice  of  starting  position. 
The  solution  to  thb  problem  b  to  take  ^  *=  ^ER. 


In  the  arithmetic  case,  let  d  be  the  span  of  the  distribution  of  5|.  A  starting 
position  determines  a  lattice  on  which  the  random  walk  lives.  Let  A(Z)  denote 
the  distance  to  the  closest  lattice  value  smaller  than  Z.  Excess  over  Z  —  A(Z) 
has  a  known  asymptotic  distribution.  The  problem  is  essentially  to  minimize 
E{Z+Y)^,  where  again  Y  is  the  excess  over  the  optimal  boundary.  Now,  though, 
Y  +  A(Z)  has  the  fixed,  known  limiting  dbtribution  L(R).  Consequently 


E{z  +  r)2  = 


=  E{Y  +  Z^AiZ)-A{Z)f 
=  EiY  +  A(Z) -ER  +  ER+Z- A(Z)) 

=  E{Y  +  A(Z)  -  ERf  +  iER  +  Z-  A{Z)f. 


The  problem  of  minimizing  this  is  equivalent  to  that  of  minimizing  {ER  +  Z  — 
A(Z))^,  as  the  first  term  is  approximately  constant,  independent  of  Z.  It  is  easy 
to  see  that  this  is  done  by  taking  Z  s  —ER  +  The  proof  is  finished  by 

observing  that,  by  the  arithmetic  renewal  theorem,  ER  —  ^  =  iESr  • 

ChernofiT  and  Petkau  consider  the  same  stoppping  problem  for  a  family  of 
random  walks  generated  by  dichotomous  random  variables 


gp  __  |(p/l  -  =  6(p)  with  probability  p 

^  =  otherwbe 


ESf  =  0,  E{Si)^  =  1.  It  is  possible  to  give  a  patbwise  construction  of  this 
process  that  shows  that  up  to  any  stochastically  bounded  time  ( the  process  b 
continuous  in  probability  as  a  function  of  p,  i.e.,  for  a  fixed  po,  and  for  p  close  to 
Po  the  paths  up  to  time  t  can  be  made  arbitrarily  close  to  those  of  po  except  for  a 
set  of  small  probability.  Thb  seems  reasonably  clear  so  proof  b  omitted.  Another 
fact  about  these  processes  that  should  be  noted  b  that  S?  b  nonarithmetic  iff  p 


IS  irrational.  Here  is  some  notation  that  will  be  necessary: 


=:  inf{n  :  5j|  >0}  and  by  induction, 

t{<">  =  iiif{y  >  :Sf>S^  „)  for  o  >  1, 

fi  =  iiif{n  :  Sg  >  0), 
rf  =  inf{n  :  5^  >  c}. 

If  p  is  irrational,  —  T+  with  probability  1,  for  =  0}  =  0  Vn. 


To  simplify  the  notation  quantities  like  E(S%)  will  be  denoted 
when  this  can  be  done  unambiguously. 


Theorem  2. 


is  a  continuous  function  of  p. 

Proof.  Note  Grst  that,  by  the  path  continuity  property,  continuity  is  obvious 
at  a  value  of  p  for  which  P{f^  ss  7^},  i.e.  p  b  irrational.  In  thb  case  the 
numerator  and  denominator  are  separately  continuous.  Thb  accomplbbes  the 
main  purpose  of  Chernofif  and  Petkau’s  result,  which  b  to  show  that  a  calculation 
which  can  be  done  for  p  rational  can  be  extended  to  irrational  p  by  continuity. 
Therefore,  it  suffices  to  cstablbh  continuity  at  some  Gxed,  rational  p. 

The  beurbtic  for  why  thb  works  b  that  no  amount  of  messing  around  near 
zero  and  continuing  by  the  random  wdk  can  affect  the  ratio  considered  here, 
although  numerator  and  denominator  separately  can  change.  The  simplest  ex* 
ample  of  thb  phenomenon  b 


Ep^Sr^  EppSr^ 


This  will  be  used  below.  It  is  an  example  of  the  heuristic  because  to  get  from 
to  the  random  walk  hits  ai  0  and  then  goes  on  to  perform  an  identical  copy 
of  rj®.  Formally 


J^Po(^r+)  —  ^po(^f+t  —  *“+) 


or 


Similarly, 


^po(^r^)  — 


/*P.{y+  =  r+}- 


which  establishes  the  claim. 


^Po(Sl) 
Ppp{r+  *  r+}  ’ 


The  second  example  of  this  heuristic  b 


Ep(SrJ  =  e(e)EpSr^+0(i) 


and 


fil.(S?,)  =  <<«)E|.S?+  +  0(€). 

To  see  thb  write 

E,(S,,)  =  E(Sr^-,  r+  =  r.)  +  E{S,,.,)  P{Sr^  e  rfi) 

—  £(Sf^) +  0(<)  +  E{Sr^',  Tf^x  —  f+)  P{Sr^  ^  dz) 

+  /,'  f  P{S,^  6  dy}P{S,^  e  dz) 

=  E{S,^)  +  0,(«)  +  (£^5,,.)  +  0j(())  PIT,  >  r+} 

+  f'  E(S,.....)  P{S,^  e  <lj)  p{S,^  €  dz] 


where  |Oi(e)|,  |02(c)|<  e.  Continuing  in  this  manner  establishes  the  claim  with 
c(€)  =  P{U  >  follows  analogously. 

Now  the  result  follows  easily.  The  path  continuity  property  makes  it  clear 


Convergence  takes  place  as  long  as  S%  >  0.  For  the  other  paths,  S^pf^  is  close 
to  zero,  possibly  above  and  possibly  below.  By  these  two  observations 

E  S«,  =£«%+£■  S»,  /  “  c(<)  6  <(1)  +  »(1), 

where  o(I)  -►  0  as  ^  p,  and  E(S^f}^  satisfies  a  similar  equation.  The  fact 
about  the  ratios  is  now  obvious. 

Here  are  some  consequences  of  Theorem  1. 

(1)  (Part  of  (2),  Theorem  3.3).  Z 
Proof.  Since  Sr^.  <  6, 

^  ES?^  bESr.  b 


Z  =  - 


ESf^  ^  bESr^^  b 
2ESr^-  2ESt^  2’ 


where  b  =  b{p)  as  above.  Jensen’s  inequality  produces  the  upper  bound 

(2)  If  p  =  ir  =  —  ^  ([2],  Section  4,  p.  882).  For  then  — o  >  6  and  |  b  an 
integer.  Under  these  conditions  it  b  easy  to  see  that  Sr^.  =  6.  For  p  =  n 
an  integer,  Z  —  also  holds  for  a  symmetric  reason. 
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